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ABSTRACT 

This study of educator intervj.ews and conferences 
required by the Louisiana teacher certification program (Louisiana 
System for Tsaching and Learnin'j Assessment and Review (STAR)) is 
grounded in the supposition that metaphors infuse educators' everyday 
professional interactions. Of particular interest were: the nature of 
the various conference roles assumed by the participants; the 
underlying beliefs and perspectives that determined these role 
assumptions; the relative degree of congruence of the roles assumed 
with the STAR model for conference participant roles; and the kinds 
of conference behaviors engaged in as a result of the actual roles 
taken. Three types of conference were discerned: Type 1 involving 
educators who were resistant to change as represented by the STAR; 
Type 2 involving educators who assumed the inetaphoric roles of expert 
panel, grievance committee, or support group; and Type 3 involving 
educators who exhibited a great degree of openness to assuming the 
STAR reflective and conference roles. The Type 3 participants showed 
willingness to interact as reflective professionals and collaborative 
learners, with the result that their discussions were more 
context-specific and data-based than discussions in conference types 
1 and 2. Appendixes include: Table of Contents of STAR; Performance 
Dimension IV: Enhancement of Learning; Teaching and Learning 
Component IV: Monitoring Learning Tasks and Informal Assessment; STAR 
Professional Development Process; and Coi./erence Metaphoric 
Role/Empowerment Continuum. (AMH) 
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Introduction 

There has been a proliferaiicn in recent years of teacher evaluation initiatives in response to 
legislation from a number of states mandating more stringent teacher certification programs (e.g., 
Georgia, Tennessee, Texas, Soutii Carolina, Virginia, Connecticut, etc.). As tliese statewide teacher 
reform uiitiatives are fueled by legislative mandates targeting teacher professional accountability and 
are consequently lied to incremental salary schedule increases, assessment program developers have 
registered considerable interest in tlie potential of teacher evaluation models as positive catalysts for 
genuine teacher professional growth and change. Thi.s study explored initial implementation effects 
associated witli the newly-developed statewide teacher assessment/certification process called the 
Louisiana System for Teaching and learning Assessment and Review (STAR) (Ellett, Loup & 
Chauvin, 1989). While this study focused on implementation effects of the STAR in Louisiana, 
infoi-mation gained from this study offers valuable insights about ".ducators* perceptions and responses 
to organizational change, particularly when it is externally imposed within the framework of state 
mandated reform. Thus, this study attempts to add to ilie research on teacher evaluation oy 
contributing to further understanding of the implications of a state-imposed teacher certification 
prognmi for affecting educators' beliefs about organizational change and professional improvement. 

The STAR is a comprehensive, on-the-job assessment process designed to expand on tlie 
efforts of otlier states to identify and assess key elements of teaching reflected in the process/product 
literature on effective teaching (Brcphy, 1986; Porter & Brophy, 1988) as well as newer concerns 
about llie assessment of knowledge of content, pedagogy and curriculum (Shulman, 1986). As 
perspectives on views of teacher-centered and child-centered approaches to education have changed 
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(luring this century (Cuban, 1990), the Louisiana STAR represents what can be considered a newer 
generation of teacher assessment instmments tl\at focuses more holistically on botli elYective leaciiing 
and learning within a context of muUiple classroom-based assessments (EUett. 1990). 

This new statewide teacher assessment/certification process has been developed in response 
to recent state legislation mandating llie periodic assessment of all bcgiiming and experienced teachers 
in Louisiana. The 1984 Louisiana Teaching Internship Program Law and the 1988 Louisiana Children 
First Act abolished lifetime teacher state certification and called for renewable teaching certificates 
for all state teachers. The STAR comprehensive teaching and learning Jissessment instnmient and 
process have bpen developed iii response to tliese legislative mmidates. The STAR is designed to be 
utilized both for the initial assessment of beginning teachers (Louisiana Teaching Internship Program 
- LTIP) and for the periodic evaluation of experienced teachers (Louisiana Teacher Evaluation 
Program - LTEP). 

Thus, tlie STAR project has involved the development and refinement of a 'state of the art* 
insdnment/model for tlie ongoing assessment of beginning leaciiers' classroom skills for tlie purposes 
of professional induction, and llie evaluation of experienced teachers* classroom performance for tlie 
purposes of renewable state certification. The STAR has been designed to assess key indicators of 
teaching and learning effectiveness. The initial assessment framework for the STAR was derived 
through a content synthesis of assessment items derived from eight other state systems (Ellett, Garlajid 
& Logan, 1987; Logan, Garland & LMett, 1989). This synthesis process generated a "baseline" 
fiamework for the subsequent devciopment of STAR assessment indicators. From this initial 
framework several important additions have been made reflecting a broadening of perspectives on 
criteria for a new generation of holistic assessments of classroom teaching and learning (Ellett, 1990). 
Among these additions are instrument components that assess reflective practice, higher order thinking 
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skills, and content stnicture and emphasis. Willi the inclusion of indicatoi. ai^.d coniponenls 
addressing these student learning concerns, the STAR represents a new generation of teacher 
assessment instmments that seeks to move the teacher assessment field forward in tenus of what is 
measured in die context of a state mandated teacher evaluation program. 

The STAR is designed to assess generic teaching and learning behaviors duu-acteristic of a 
wide variety of classroom environments and levels. Through focusing on specific contextuiU factors 
present in tlie learning environment and the individual differences of learners, die STAR allows for 
the assessment of a set of core classroom teaching and learning behaviors found in cognitive- and 
perfomiance-oriented classrooms on the elementary, middle and secondary levels. The STAR model 
requires that teachers be assessed independently in die classroom by a team consisting of: the 
building principal, a master (peer) teacher, and an outside evalualor. The assessment process includes 
multiple scheduled classroom observations of die teacher as pan of the assessment/evaluation process. 
Each member of the assessment team observes a separate lesson within a five to seven day unit 
planned by die teacher. These three obsei-vations occur in die Fall and again in the Spring during die 
assessment year. 

Two important aspects of die STAR assessment philosophy are: 1) focusing the assessment 
light on learners, and 2) utilizing fomiaiive and summative post-observation support conferences as 
an integral pait of die total assessment process targeting die professional development and growth of 
teachers. The principal focus of the STAR'S classroom-based assessment framework is on die 
teacher's ability to enhance student learning. The teacher can best ensure the enhancement of 
students' learning through reflective planning. As an integral m of tlie STAR assessment process, 
the teacher develops a five to seven day Comprehensive Unit Plan (CUP) for review and assessment 
by STAR team members prior to die scheduled obseivaiions. STAR assessors make uiformed 
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professional judgments regarding the quality of the teacher's Comprehensive Unit Plan in terms of 
including adequate planning for accommodation of individual learner differences, and for active 
involvement of students during lessons in higher order thmking. Tins notion of reflective planning 
for effective learning is an important one in the STAR assessment framework. It hivolves Uie 
teacher's ability to prepare differentiated meiliods/materials and an adequate range of learning tasks 
to accommodate student needs, and requires that the teaclier include in the Comprehensivf Unit Plan 
provisions for actively monitoring students' progress during lessons to ensure that learning is 
enhanced for till students. 

This study utilized tlie revised second pilot year edition of the STAR (Ellett, Loup & Chauvin, 
1990). Tlie STAR contains 140 indicators of teaching and learning effectiveness. These indicators 
are classified into four Performance Dimensions (Preparation. Planning and Evaluation; Classroom 
and Behavior Management; Learning Environment; and Enliajicement of Uaming) that are 
operationalized by twenty-three Teaching .'md Learning Components. The components include 
concepts such as lesson initiatioi, pace, classroom routines, teaching methods and learning tasks, time 
management, managing task-related behavior, thinking skills, monitoring learning tusks, feedback, etc. 
An outline of tlie STAR dimensions and components is presented in Appendix I. As an example of 
the content of die STAR document, the introductory section to Dimension IV 'Enhancement of 
Learning' and tlie teaching and leaiTiing indicators comprising the STAR Component IV.G 
'Monitoring Learning Tasks and Informal Assessment' is provided in Appendix 11. 

The STAR Professional Development model is innovative in that it links a multiple assessor 
observation framework with a process for post-observation conferences and peer collaborative review. 
The pun^ose of the STAR conferences is to provide structured opportunities for assessment team 
members and die teacher to engage in collaborative reflection on teaching and learning and to focus 
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the attention of all conference participants (ilie teacher as well as assessment team members) on 
professional growth. The resul: of the STAR conference is the development of a 'Continuing 
Professional Development Plan' that facilitates further refinement of Uie teacher's perfonnf .ce skills 
md targets the greater enhancement of students' classroom learning. As such, tJie STAR professional 
development conferences constitute the most important element of ilie total STAR "assessment year" 
process. 

The focus of the STAR conference process is an empliasis on collaborative reflective practice 
as a means to professional growUi. In delineating specific "steps" to professional growth diat tlie 
teacher and assessment team members should follow before, during and after the STAR conference, 
the STAR conference model creates specific "roles" that participants should assume as they engage 
in collaborative reflection about classroom assessment data. Proper assumption of STAR conference 
roles by participants is a necessary prerequisite to the development of a meaningful professional 
developmem plan. The next section presents a brief description of ihe key conceptual elements of 
the STAR Professional Development Process and collaborative conference model. 

The STAR Professional Development Pi ocess - 
The "Collaborative Renective Practice" Conference Model 
The STAR Professional Development Process presents a model for collaborative professional 
growtli Uiat incorporates recem tliinking on the value of practical reflection on professional action 
(Schiin, 1983, 1987). This practical reflection encompasses the notion of "reflection on action" as 
forming tlie basis for ongoing professional practice ("reflection in action"). The STAR philosophy 
of professional growth is grounded in a tlieory of practical reflection that defines reflective practice 
as the professional ability to make rational choices and to assume responsibility for those choices 
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(Zcichnci- & Liston, 1985; Goodman. 1984. 1988; Ross. 1989). This individual reflection can also 
be mediated and enhanced Uirough professional sharing and discussion among colleagues (Pugach & 
Johnson. 1990). 

Ihe STAR moJel emphasizes the importance of informed, reflective practice for promoting 
teacher professional development to enhance student learning. In the STAR model tliis reflective 
practice is both integrative and collaborative. It is integrative in tliat it requires continuous reflection 
by the teacher and assessment team members on classroom observation data. The STAR model also 
emphasizes tlie value of collaborative conferences as important opportunities for professional sharing 
among educators. This professional sharing requires a mumal commitment to professional growth 
among all educators involved in the STAR process. 

The total STAR Professional Development Process involves both the teacher and assessors 
in a series of professional development "steps" designed to facilitate data-based reflection and 
collaborative discussion. A diagram depicting the steps in the STAR process is presented 
Appendix m. As data are collected through observations and assessments of lessons, both the 
assessors and the teacher become involved in the process of individual reflection on action. Teaching 
and learning obsei-vation events are individually reviewed and analyzed using Uie STAR teaching and 
learning components and indicators as a reflective guide. The teacher receives an assessment profile, 
consisting of component mauices of individual assessment decisions from all assessors, shortly after 
the observations and assessments have been completed and prior to Uie post-assessment conference. 
Assessment team members also confer as a team prior to the conference in order to compare and 
discuss the teaciier's perceived suength areas as well as targeted areas for professional growth that 

emerged from the assessments. 

These individual and team reflective activities engaged in by the teacher and assessors prior 
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to the STAR conference represent an additional dimension included in tlie STAR Professional 
Development Process of die concept of "reflective planning for effective learning". Through 
involvement in Uiese pre-confercnce individual and team reflective activities, both the teacher and 
assessors come to tiie post-assessment conference best prepaied to engage in collaborative discussion 
about performance strengths and targeted professional growth areas that will facilitate boUi teacher 
and team member professional learning and development. Tliis collaborative reflection among 
conference participants include;:.- the joint development of the teacher's Cominuing Professional 
Development Plan. This plan specifies the kinds of professional growth activities and tasks to be 
performed by the teacher, how reflective data on these activities will be collected and reviewed, and 
includes provisions for collaborative monitoring and feedback by team members (Appendix IV). 

Thus, ilie post-assessment conferences constitute the focal point of the total STAR assessment 
process. Tliis process includes two post-observation conferences that are conducted by STAR team 
members witli die teacher - a first conference (formative) after the first round of fall observations, 
and another (summative) conference afier the second set of observations in the spring. This series 
of observations and post-assessment conferences spanning two semesters comprise the teacher's 
STAR "assessment year". A unique feature of Uiese STAR teacher conferences is du rMew with 
the teacher of the teacher's classroom teaching performances and students' Icun in;.; -viihin the 
framework of die "assessment year". These conferences are designed to a^ow for maximum 
interaction with the teacher and team members, and to provide the teacher with .i ^lp^ul infonnation 
regarding his/her perceived classroom strengths and targeted professional growth areas. As such, the 
generation during the conference (by the teacher with the team members) of tlie Continuing 
Professional Growth Plan represents die principal feature of the STAR post-assessment conference. 
This professional contract between the teacher and assessment team members is designed to be 
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positive and supponive in nature, and emphasizes boUi tlie commitment of die teacher and the team 
members to the teacher's continued professional growth and development. These conferences 
represent the important focus of die STAR assessment framev^ork and serve to provide die teaclier 
with as much professional support as possible Uiroughout the assessment process. 

As reflective practice forms the basis of the STAR model of professional development, the 
collaborative nature of STAR conferences provides an important means for promoting die 
development of "shared perspectives" among participating educators. The mutual involvement of die 
teacher and STAR assessment team members in the professional development process requires a 
willingness of all participants to engage in an equid partnership and shared commitment toward 
enliancing teachiiig and learning. The STAR conferences, Uierefore, represent important professional 
gi-owdi opportunities for the assessment team members as well ar. the teacher. Through review of the 
teacher's assessment profile, discussion of specific observations, tmd analyses of professional growth 
alternatives, STAR conference members can jointly arrive at better understandings of the complexities 
of die contextually-based assessment of effective learning environments. The teacher addidorally, 
through interacting on an equal professional basis widi STAR team members, gains valuable 
confidence and support as collaborative reflection efforts delineate areas for continuing professional 
growdi. 

Thus, die STAR Professional Development Process is based on a philosophy of meaningf\il 
professional growth through professional reflective practice. This philosophy reflects key assumptions 
or beliefs aboui meaningful professional development within the context of a teacher certification 
"team assessment" framework. Tlicse key STAR assumptions/beliefs are summarized below: 
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Meaningful nrofessional growtli/leai ning . . . 

• requires a personal commitment from tlie teacher ami assessors 

• involves ongoing reflective practice that is context-specific and data-based 

• is a product of collaborative efforts 

• includes ongoing monitoring of activities and sharing of results 

• embraces activities that are Icamer-centered 



These STAR belief, concerning professional growth require that teachers and assessors assume 
specific STAR professional development "roles" during STAR conferences. The underlying key 
STAR beliefs are generative of metaphoHc roles for die STAR process that center on the teacher and 
assessors as rejlective professionals and collaborative learners. Tlirough proper assumption of these 
STAR professional development roles, teachers and assessors ai'e able to engage in shared reflective 
actions during STAR conferences that lead to refined understandings about Uie nature of effective 
teaching and learning. In conference interactions as reflective professionals and collaborative learners, 
the teacher and assessment team members become involved in professional reflective actions that are 
open-ended, comext-specific and data-based, and that focus on professional learning. These reflective 
actions engaged in by teachers and assessors include: 

• reviewing STAR assessment profile? to determine specific strengths and areas for 
contmued professional growth 

• anchoring discussion of strengths/growth areas by focusing on analyses of specific 
events and .situations occurring during classroom observations 

• analyzing ilie specific nature of selecte( nreas for professional growth and how tliey 
might affect students' learning 
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framing and reframing the selected areas for professional growth through open 
discussion of specific classroom observation examples 

• deciding on various implementable methods/lechniciues for positively impacting on 
these professional growth areas 

• exomining tlie possible implications for students' learning of various 
methods/techniques .•ieb'^.ted 

establishing an appropriate plan for collaborative monitoring of successful 
implementation of selected professional growtli acliv^.es 

Thesp. conference participant actions highlight the specific nature of tlie STAR conference 
roles of "renective professional" and "collaborative learner". These roles facilitate the collaborative 
development of the teacher's professional growth plan. As the professional growtli plan is decided 
on during the conference, the primary responsibility for implementation does rest with the teacher. 
However, the principal and other assessors, in fulfilling their ro^^^s a- collaborative learners, also share 
mis responsibility by assuming "monitoring" roles as various piofessional development activities are 
implemented. By extending die collaborative conference efforts through monitoring and by providing 
continuous feedback to teachers, team members increase the potential for teachers' meaningftd 
professional growth. 'Huis. thmugh assumption of these STAR professional development roles, 
educators during conferences are able to engage in useful renective dialogue about professional 
icaciiing practice and share collaboratively with a focus on the improvement of students' learning. 

Conceptual Focus of the Study 
The study reported here represents an analysis of tlie qualitative effects of implementing the 
STAR compreiiensive classroom teaching and learning assessment model in nine schools. This study 
is grounded in tiie supposition that metaphors infuse educators' everyday professional interactions. 
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This fundamental premise is reflective of the view of Lakoff & Johnson (1980) tliat "...our conceptual 
system is largely metaphorical...thc way we tliink. what we experience, and what we do every day 
is veiy much a matter of metaphor". As such, professional conferences hwolving teachers and 
assessors become interactive arenas where educators, come together, and in which professional 
learning ^environments are continually created and reinforced through metaphoric role assumptions. 
Conterences are affected and become structured by the kinds of metaphor constmcts that assessors 
and teachers wittingly or unwittingly employ. Recent studies have begim to explore teacher belief 
structures and the metaphors they generate (Tobin & Ulerick. 1989; Provenzo. McCloskey. Kottkamp. 
&. Cohn. 1989). This present study seeks to extend Uiis line of inquiry to the kinds of metaphoric 
roles Uiat emerge in die context of a teacher assessment/team conference model, and the ways in 
which these roles are reflective of educators' underlying beliefs. 

Tlus study focuses on a metaphorical analysis of the actual roles that paiticipants assumed 
during the STAR conferences conducted wiUi the teachers in tlie nine schools. The conferences 
completed in Uiis study exhibited a wide range of participant role behaviors that either facilitated or 
inhibited collaborative reflection among participants. Of interest to the researchers in tlie analysis 
were die nature of die various conference roles assumed, the underlying beliefs and perspectives of 
the educator participants that deteniiined these role assumptions, the relative degree of congruence 
of ilie roles assumed with die STAR "model" for conference participant roles, and the kinds of 
conference behaviors engaged in as a result of the actual roles undertaken. The analyses of 
observational notes taken during the conferences also sought to detennine die ways in which 
conference participants dealt wiUi role ambiguity and role conflict (disjunctiveness) when attempting 
to engage in "focused" discussions about context-specific teaching and learning events that occurred 
during STAR classroom observations. 
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rnnferp.nce Mel^p''""'^ Role/Eiin p"'<"^rmCTt Conlinuiim fCMR/EQ 

As a means of conceptually focusing on the effects of the incorporation of this new STAR 
process tato the overall school context, an Bnpowerment Metaphor Continutm, (Claudet & Ellett, 
1989) was adapted and utilized as a way of determining the nature and quality of metaphoric framings 
engaged in by participants durmg conferences in the nine schools. To this end. a -Conference 
Metaphoric Role/Empowerment Continuum' (CMR/EC) was employed as a way of operationaUzing 
the notion of metaphoric framing occurring during teacher conferences. It provided a means for 
structuring and categorizing the various "metaphoric roles" identified from tl,e conference observation 
notes. The conference metaphors isolated in this study were thus arranged on the CUmC 
(Appendix V). The CMR/EC defines metaphors that are relatively tmnsferentiat a..d/or transactional 
in nature. Metaphors that are considered to be inhibitive of active u.volvement of participants (U,e 
teacher and assessment team members) in prescribed conference activities are U,ose that fail to 
promote or eticourage STAR conference participant actions that center on professional reflection and 
collaborative learning. Metaphors falling toward this end of the CMR/EC are labeled •■transferential" 
as they are based on simply a "trmisfer" of power from the teacher to U.e team (or vice versa), or a 
relinquishing by one or more team/conference members of role authority to another member, and do 
not resuU m high participant involvement in the conference objectives. Tl.ese kinds of metaphoric 
roles thus fail to "empower" boti, teacher and team .nembers toward productive conference 
collaboration. On the oth :r end of the CMR/EC are metaphors U,at tend to promote higli participant 
involvement in conference objectives. Metaphors falling toward this end of the CMR/EC are labeled 
"transactional". They are based on ongoing reciprocal interactions between the teacher and 
assessment team members during the conference activities. These metaphors serve to promote active 
panicipant involvement in conference objectives, and effectively empower both teacher and 
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assessment team members toward achieving productive conference results. 
Research Questions : 

Based on the above conceptual framework, Uie following research questions were generated: 

1. Do professional team conference members and teachers engage in discernible metaphors 
reflective of variations in underlying beliefs/perspectives? 

2. Can these conference metaphors be understood on tlie basis of a transactional/uansfercntial 
metaphoric role/empowerment continuum? 

3. What is the relationship between conference metaphors discerned, participant role 
empovcrment and tlie potential for professional growth and change in teachers? 

Data Source 

Tliis study utilized data collected over a period of three months in the spring of 1990 as part 
of an initial criterion-related vplidity study of the Louisiana System for Teaching and learning 
Assessment and Review (STAR) process (Ellett, Loup & Chauvin. 1989). Tins preliminary trial study 
of the total STAR assessment process was completed in nine schools in one urban Louisiana school 
district during tlie Spring of 1990. Tiie nine schools involved in llie study varied on two dimensions: 
(1) grade level of students served: elementary, middle, high; and (2) socioeconomic status (SES) of 
student body: low, middle, high. Two SES variables were used in the selection process for the nine 
schools: percentage of mothers who had some college education and percentage of fathers with white 
collar jobs. 

Schools in each of the three grade levels were categorized using these SES data. Due to 
differences in ranges on the SES data between grade levels, a separate procedure for selecting schools 
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for each grade level was determined. Data on regular education students only were used in selecting 
the schools. For the elementary schools, tlie following categories were established: (1) loyiSBS: 20- 
39% of motliers had some college education; 4-15% of faUiers were white collar employees; ,2) 
middle SES: 40-48% of moUiers had some college education; 16-30% of fathers were white collar 
employees; and (3) high SES: 49-68% of mothers had some college education; 31-70% of fathers 
were white collar employees. For the middle schools, Uie following categories were established: (1) 
low SES: 36-47% of moUiers had some college education; 18-32% of fatheis were white collar 
employees; (T\ middle SES : 49-57% of mothers had some college education; 34-42% of fathers were 
white collar employees; and (3) high SES; 58-72% of mothers had some college education; 46-74% 
of fathers were white collai- employees. For the high schools, tlie following categories were 
established: (1) low SgS: 20-39% of mothers had some college education; 4-15% of fathers were 
white collar employees; (2) middle SES : 40-48% of mothers had some college education; 1 6-30% of 
fathers were white collar employees; (3) high SES: 49-68% of mothers had some college education; 
31-70% of fathers were white collar employees. Once schools were categorized as low. middle, or 
high SES, one school from each category was randomly selected to participate in the study. A total 
of 54 teachers (6 teachers in each school - two . ims, two beginning teachers and two experienced 
teachers) participated in a three month (March through May) "abbreviated" version of the STAR 
model assessment year. 

The nine sets of principals and master teachers participating in the smdy completed a 
comprehensive seven-day STAR assessor certification training progiam prior to the initiation of the 
nine school study. This certification program involved educators in extensive practice in assessing 
a variety of classroom lessons through use of video segmems. Follow-up discussions of these 
assessment simulations served as a means of refining understandings and correct interpretations of 
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STAR components and indica.ors "in conto.r. Upon successful completion of a«se video simnlmion 

excuses, principals and master teachers were U,en field-certified in using the STAR to assess actual 

everyday teaching and lean,ing practice in classrooms throughout the state. 

Data for this study included STAR assessment results on patticipating leaders, interviews 

conducted witl, STAR team members, observation notes taken during STAR Comprehensive Unit Plan 
interviews atK- post-assessment conferences, and participant survey responses and assertions regarding 
their beliefs about effective teaching, LTIP/LTEP and the STAR. Interview and observation data 
were collected by nine members of the university research team also serving as the •'outside asses.,0,." 
for the STAR assesstnent teams. Educator assertions and some interview data were collected by 
teacher researchers in llie schools. 

Melhodoloey and Data Analysis 
in concepmalizing about educators' conference roles and their tnetaphoric basis, tl,e 
researchers began with the assumption that me.aphoric roles represent attempts by educators to 
communicate tlteir perceptions and understandings. Thus, the metapho,. that fran.e participants' roles 
and role differentiations during conferences can be viewed as symbolic manifestations of the 
underlying key beliefs and perspectives which educators hold. Therefo,.. the researchers frst focused 
on analyzit^g the nature of participants' beliefs and perspectives as a tneans of gaining insight into 
the underlying impetus for participant roles assumed during conferences. 

Throughom the three months of the study the nine teacher researcheni wrote down "assenions" 
reflecting casual remarks, comments, and specific statements obtained from conversations with other 
educators in Ute school. These data were reported by the teacher teseatdters in the form of initial 
assertions. These initial assertions represented fairly specific statements, wUh little inferencing on 
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the pari of the teacher resejirchers. Tliese initial assertions were directly tied to educators' comments, 
eitlier through direct quotes or by paraphrases. 

The assertions collected from educators in Uie schools by the teacher researchers provided data 
that could be analyzed to determine key beliefs and perspectives that were held by study participants. 
As these assertions were obtained tlinwgh informal conversations with as many teachers a. d 
administrators in the school as possible in addition to those educators specifically participating in the 
STAR assessments, these assertions could be considered reflective of normative belief structures 
existing in the school. These initial assertions were then gi-ouped into categories, representative of 
emergent tliemes in the data. General statements exemplifying these categories then formed the basis 
for higher (level two) assertions. Finally, these higher level assertions resulted in the emergence of 
a few theory-based assertions from the entire data set which are presented in the Discussion and 
Implicxtions section of the paper. Common Uiemes (level two assertions) emerging from the entire 
dataset of level one educator assertions are presented in tlie Results section below. 

Observational data were collected (by a non-participant researcher "sitting in" during the 
conferences) on the post-observation conferences conductea in six of the schools. A total of 61 
conferences were observed. These notes consisted of the recording of important verbal as well as 
nonverbal cues/behaviors exhibited by participants during the conferences, and other pertinent 
actions/infomiation gleaned during conference obsei^ations. Observational notes recorded during 
these conferences were then categorized, coded and analyzed using an interpretive meUiodology 
procedure described by Erickson (1986). In constructing the categories of conference context 
parameters derived form the observational notes, comparisons were made with conference notes made 
by the 'outside assessor* members of die assessor teams, who were also involved in the study as 
university researchers. This peer debriefing served as a means of triangulating and verifying the 
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categories detemuned. Conference incidents recorded in tlie observational notes were compared 
iteratively wiiii the categories being generated, resulting in a final set of integrated conference context 

categories and their properties. 

As an integral part of tlie inteipretive process, the context categories were concurrently 
analyzed to determine the presence of nietaphoric framings. Verbal and nonverbal participant 
bcliaviors/cues represented in die individual categories were reviewed and analyzed for yielding 
disceniible. recurring metaphors. The specific metapliors isolated were Uien analyzed in terms of their 
relative success in enhancing participants' role effectiveness during conferences. Based on this 
analysis, specific metapiioric roles isolated in tiie study were labeled, grouped and placed on the 
Conference Metaphoric Role/Empowerment Continuum (CMR/EC). Finally, as a means of 
determining the 'effects' of tlic STAR conference framework on participants, interviews widi 
participants were completed by three "external evaluators". These intei^icws served as an additional 
means of triaiigulating the data collection process, and in obtaining information on the ways in whicli 
the conferences miglu have influenced participants' beliefs. 

Results 

Participants' Underlying neliefs/Pcrsncctivcs 

The initial assertions collected in the study were analyzed and grouped into categories. This 
categorization process resulted in tlie generation of a set of common themes representing educators' 
beliefs/perspectives about: (1) teaching and learning; (2) preparation and planning (STAR 
Comprehensive Unit Plan); and (3) LTIP/LTEP and the STAR. The final set of common Uiemes 
derived from tlie analyses are presented below. 
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I. EDUCATORS' BELIEFS/PERSPECTIVES ABOUT TEACHING AND LEARNING: 

The degree to which personal beliefs about teaching and learning were congnient with 
key elements of the STAR appeared to influence educators' acceptance of the STAR 
as a valid system. Tliese personal beliefs about teaching and learnmg mvolvcd 
notions concerning: 

* Content coverage versus students' learning 

* Activity versus learning 

* Emphasis on excuses versus opportunities 

* Attitude towai'd professional development 



n EDUCATORS' BELIEFS/PERSPECTIVES ABOUT PREPARATION AND PLANNING 
(COMPREHENSIVE UNTP PLAN): 

Teachers : 

Planning appeared to be thought of in terms of "things to do'' to fill the time 
available, radier tlian as "steps" that lead to accomplishn.ent of what students are to 
learn and know". 

Teachers seemed to have much difficulty in structuring content. Wliile little difficulty 
was observed in discussing rationales for activities, discussions of rationales for 
content order and structure was either difficult for teachers OR content was not clearly 
included. 

Teachers seemed to have much difficulty in planning for students' needs and abilities 
(accommodating individual differences). 

Teachers did not understand how to use content in STAR Performance Dimension I 
(Preparation. Planning and Evaluation) to structure a Comprehensive Unit Plan^ 
Teachers expressed a desire for samples, formats and models from which they could 
copy They expressed much difficulty in coping with open-ended possibilities of 
structuring a comprehensive plan for a given body of content and a particular group 
of students. 

Despite difficulties experienced in structuring a Comprehensive Unit Plan (CUP), 
teachers who did complete such a plan were self-reportedly more prepared and 
organized than when a CUP was not constructed. 
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Assessors ; 

• The Comprehensive Unit Plan helped to clearly establish the teaching and learning 
context to be obsei-ved. Assessors more clearly knew what to expect than with a brief 
daily lesson plan. 

• Teachers seemed to be more comfortable in lessons resulting from the preparation of 
a Comprehensive Unit Plan, and activities during the lesson appeared to be more 
organized, efficient and effective in terms of student involvement than when daily 
lesson plans were used. 

• Preparation of a Comprehensive Unit Plan appeared to enhance subsequent success 
in tlie teaching and learning process during lessons. 



EDUCATORS' BELIEFS/PERSPECTIVES ABOUT LTIP/I.TEP AND THE STAR: 

• Despite careful pli\nning and research, the STAR'S ultimate success will hinge upon 
the attitudes and commitment of all persons involved in its implementation. 

• Lack of information, mmors and much "misinformation" translate into educators being 
feaiful of the STAR and the LTIPA-TEP process. Educators were also mistrustful of 
pilot implementation and use cf die STAR in tliese processes. However, where 
information was share' i in a positive and professional manner, educators appeared 
more comfortable and positive. 

• For many, perceptions did not allow for a pilot period; implementation besan with 
legislation. 

• The initial view of tlie STAR as a process for "getting rid of bad teachers" appeared 
to prevent educators from focusing on the potential of professional development and 
collaboration for enhancing students' learning 

• The STAR is viewed as a certification/licensure procedure rather than a process for 
assessing everyday teaching and learning practice. Teachers are viewed as being 
required to put on a "dog and pony show" that has nothing to do with enhancing 
professional practice. 

• There is widespread confusion among educators concerning the differences between 
employee issues of tenure and employment and state certification/licensure 

• There is considerably more opposition to any violation of the "lifetime certificate" 
(sacred norm), tlian to the specific content of the STAR (viewed as usefiil in 
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professional development). 

Teachers and administrators place emphasis on hindrance factors associated wiUi 
STAR implementation (e.g., time, money, scheduling and otlier "extra effort" 
concerns) rather than possible long-term payoffs of the program. 



Conference Metaphors Discerned 

These beliefs and perspectives about teachmg, student learning, and tlie STAR were carried 
by assessment team members and teachers into the STAR conferences. The beliefs that were held 
to a great extent determined the nature of the roles that participants were willing to assume during 
the conferences. The conferences that occurred in this study in many instances demonstrated 
inconsistencies that existed between participants* beliefs and STAR conference "model" roles. Tliese 
inconsistencies were reflected in conference dialogue that was relatively directive, close-ended and 
unfocused. 

An array of conference metaphors were discerned from the content analyses completed that 
were differentially distributed along tlie CMR/EC (Appendix V). Metaphors discerned were reflective 
of both transactional and transferential conference behaviors engaged in by assessment team memb-^rs 
and teachers. The CMR/EC depicts the differential placement and spread of metaphoric role usage 
along the transferential/transactional continuum. The horizontal bar shadings denote the relative 
intensities with which metaphoric roles were engaged in by conference participants aiid the effects 
on resulting transferential/transactional empowerment levels. Metaphors isolated that produced 
transferential conference role empowennent included the metaphors of conference framework as 
grievance hearing (M2) and teacher as victim (Ml). Metaphors isolated which were utilized by 
assessment team members tliat were "transferential" in nature included the assessment team as expert 
panel (M3); and. within the team itself, the principal's self-perception of having "superior conference 
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expertise" in relation to oUier team members. Metapliors discerned which were '.acre "transactional" 
included the assessment team as support group (M4). and assessment team as professional resource 
network (MS). Tlie STAR "model" roles for teachers and assessors of reflective professionals (M6) 
and collaborative learners (M7) complete the continuum. 

These metaphors were found to be reflective of construct properties associated with categories 
detennined from the recorded notes. Comext categories defined fiom Uie observational data included: 
1) relative willingness of conference particioants to engage in •risk-taking* during conferences; 2) 
degree of principal inclusion of otiier team members (particularly the miister teacher) in die 
conference process; 3) variability in successful 'conference role' comprehension and assumption by 
team members (principal, master (peer) teacher, and outside assessor); and, teacher feeling of 
•personal ownership' in the conference process/professional growth plan. A discussion of die 
metaphors discerned, tlie interrelationships between context categories and metaphors discerned, 
including considerations of the conference "effects" on participants (both teacliers and team members) 
are discussed below. 

Transferentlal Role Metaphors ; 
(Ml) Teacher as victim 

This metaphor emerged from statements expressed by teachers during conferences. Tiiis 
metaphoric role was assumed to a varying degree by teachers in the conferences observed. Although 
apparent in some teachers* verbal interactions, it was also easily recognizable in teachers' nonverbal 
behaviors as well. Conferences which were held in the principal's office appeared to contribute to 
exacerbating teacher feelings of victimization. The conferences that took place in the principal's 
office were usually those that were held in the early morning before school. The principal would 
often explain that die conferences needed to be held in the office so he/she could make Uie 
announcements and attend to other "beginning of the day" concerns. Additionally, althougli in these 
conferences one or more team members would often make initiating statements that &: first seemed 
to cause teachers to feel more at ease, many teachers still engaged in dialogue indicating diat Uiey 
perceived Uiemselves as a "victim" of the assessment process. 
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"I really don't think assesrors not familiar with my content area can come in and evaluate the 
way I teach thinking skihs. There's just too much the assessors aren't aware of..." 

"I know you all are going to tell me what I did wrong...tIiere ai"e so many indicators to tliink 
about while I'm teaching..." 

"I tried to do something new and different and creative with the kids...but I jus>t froze up...I 
got more tense as the observations proceeded...! feel that this [the STAR] causes a lot of 
pressure". 

"Are you going to streamline this process before it will be implemented? This seems like a 
very cumbersome process, especially for teachers.. .Will the money be there to do all of tliis?" 

"Tliese indicators about student involvement seem very rigid.. .they insist tJiat if one student 
is passively involved then the teacher loses these indicators..." 

"I don't panicularly like the way the STAR causes so much anxiety...plus, it creates a lot 
more work for you". 

Statements made by the principal and/or master teacher in these conferences also tended to reinforce 
this metaphor. 

(principal) "You knov.', I'm the one who hired you, so I don't want you to have to go llirough 
something tliat's going to reflect negatively on you and cause you to do poorly". 

(principal) "I really don't remember how I scored you on your first observation...! just scored 
the form and forgot about it". 

(master teacher) "I talked to her about those kids she has in the front of the room...I discussed 
this with her, but tlie supervising teacher hiis it set up a ceitain way... I don't feel that we 
should get her on tliis one". 

(principal) "She is already a wonderful teacher, just not according to these indicators". 



(M2) Conference framework as grievance hearing 

In many of the conferences observed, teachers (especially those who were more vocal) would 
seize opportunities during the conferences to express their opinions and/or "grievances" regarding the 
assessment process. These grievances would often be framed in tlie form of direct questions to the 
team in general regarding their concerns about paiiicular STAR components and/or indicators. 
Although team members were informed (as part of their STAR certificadon training) in the 
importance of maintaining well-focused conference discussions, conference dialogue would often be 
interspersed with verbal exchanges between teacher and team members concerning die meaning and 
interpretation of indicators, the teacher's self-perceived inability to accommodate ijidividual student 
differences in "that situation", policy and procedural concerns, how the process simply creates "extra 
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work" for teachers, etc.: 

"Is it true that you checked me on 140 different things? I just don't understand how?" 

"Wliat if I have a new student assigned to my chiss on a day that I am observed?" You can't 
expect them to be at the same level of understanding as the rest of the class..." 

"With this class, it's just impossible to incorporate everything that's in the STAR.. .in this 
situation, I just have to take things one step at a time. ..I need to present the material and let 
them get that down first..." 

"You know, getting students to become actively involved is more complicated tlian the STAR 
describes. ..there's really more to it than this...students are not going to come out and tell you 
they don't understand something in front of the other kids". 

"I iliink there are just some things a teaclier must do with students Uiat Uie STAR can't 
measure.. ..uch as showing patience and understanding". 

"I really believe that this STAR program should not affect people with life-time 
certificates.. .we should be able to keep thciu. Tiiis tiling should be phased in and only affect 
first-year teachers." 

"Tlie master teacher coming in should be in my area...if I'm teaching math, I want to be 
assessed by another high school math teacher, not an English elementary teacher." 

"Come in here and look at what I'm doing and tell me if it's good or not, but don't ask me 
to put on a 'staged presentation'..." 



(M3) Assessment team as expert panel 

This metaphor surfaced as the predominant metaphoric role as.sumed by conference team 
members in the STAR conferences observed. The assessment team as expert panel metaphor was 
reinforced considerably by teacher behaviors during the conferences as well as tlie kinds of questions 
that teachers posed to team members. In the conferences observed in which this metaphor emerged 
team members were found to center the discussion around their own knowledge of tlie STAR 
instrument and process, allowing less opportunity for dialogue with the teacher about classroom 
teaching and leju-ning events. The principals in the conferences observed were the tei^m members 
most often found to "take over" the discussion. Their non-verbal demeanor sometimes conveyed a 
sense of having "enperior conference expertise" in comparison to the master teacher. When teachers 
did speak, their comments were usually phrased in the form of direct questions to either the principal 
or master teacher. Tliese questions were most often about planning techniques, observation concerns, 
procedural matters involving the STAR process, etc.; 

"Wliat if I have a student that comes in on the day you observe that hasn't been to school in 
two weeks? Wliat am I supposf.d to do with him?" 
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"What if I am really far behind m my lesson plans? What does tiiat do to my observation for 
the day?" 

"What about llie student that always sleeps tlirough everything? I know tJiat is going to 
happen..." 

"Can I make changes in my plajis in the middle of tlx lesson if I need to, if the students 
aien't getting it?" 

Thus, teachers to a great extent relied on assessment team members as "experts" in the STAR 
a.ssessment pro'^ess, and to be able to provide them with answers to their questions. 

Transactional Role Metanhoi s ; 

(M4) Assessment team as support group 

In combination with many of the more transferential metaphors already described, many of 
the principals and master teachers were very vocal both in pre-conference meetings and during the 
conferences in emphasizing their desu-e to "support the teacher". Assessment team members seemed 
particularly conscious of their roles as a "support group" and frequent remarks during conferences 
concerning tins role were noted: (principal) "We want you to know that we are hear to help you and 
to provide you with support during your assessment..."; "(master teacher)... please taiow that I'm 
available to talk to whenever you might want...if would like to discuss anything about tlie 
observations and assessments". In the majority of conferences the principal made a point of being 
verbally supportive of the teacher. Principals would often offer excuses for a teacher's unacceptable 
performance such as: 

"I know you're not really familiar with the STAR and you don't know exactly what is 
expected of you. ..When this is tlie real thing you will be prepared and do much better". 

"We realize what kind of snjdents you have to work with and ihey are not motivated". 

"I know reading is not your area of certification and that may be a lot of the problem with 
content". 

"We realize yoj have never studied the STAR in detail, and are not sure of what it is about, 
but this is what it says..." 



(M5) Assessment team as professional resource network 

This metaphor surfaced in conferences thr.t were characterized by dialogue wliich focused 
more directly on context-specific events and ocojrrences from the classes observed. There was no 
clear pattern emerging from conference notes in terms of either the teacher or team members initiating 
the context-specific discussions. In some instances, the specific questions were posed to the teacher 
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by team members about an event that took place during an observation, wliile on otiier occasions the 
teacher queried a team member about the appropriate handling of a classroom event. As some 
conferences reached this dialogue level, the principal and/or master teacher in the conference would 
often begin emphasizing the resource potential of each other or odier teachers in the school for 
providing professional assistance and infomiation to the teacher regarding one or more identified 
teacher/leaming professional growtli areas. 

(master teacher) "You know, I've experimented for a long time with different ways of 
effectively monitoring my smdents.. in order to find the kind of questioning strategies that 
really work. I would want you to kiow that you can come in and observe my classroom to 
see what I'm doing..." 

(master teacher) "I want you to come and talk with me about tliis 'peer tutoring' idea that 
we've discussed. ..I'd like to share some things with you". 

(principal) "Tlie state department and our local school board have been working much more 
closely in temis of helping us financially with aids and materials teachers need. I want you 
to be aware of all tliat's been made available for your use". 

(principal) "Monitoring of your students is probably the most important thing that you as a 

teacher can do... I would encourage you to have myself and/or Mrs. come in and 

infomially observe you as often as you would like to give you additional feedback on your 
monitoring strategies". 



Discussion 

The researchers were interested in the potential of tlie various metaphoric roles engaged in 
by conference participants for inhibiting or promoting "reflection on action" within the conferences 
as well as continued "reflection in action" following conferences. T\\c conference metaphor analysis 
confimied initial expectations that metaphoric roles which were cleariy transferential in nature 
inhibited participants' abilities during the conferences to reflect on action. Additionally, conference 
participants employing a variety of roles in combination (e.g., combining "expert panel" witl) "support 
group") also experienced some difficulty in using these metaphoric role ensembles to produce 
purposeful dialogue. 

Through engaging in iterative analyses of participant beliefs, as well as discerned metaphoric 
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roles and tlie resulting effects of these roles on educators' conference behaviors, tlie researchers were 
able to arrive at a general typology of conference dialogue/behaviors representing tlie "kinds" of 
conferences observed in die study. Tliis typology was constructed as a way of arriving at a better 
conceptual understanding of the interrelationships of participant beliefs, how tliese beliefs were 
generative of inetaphoric roles, and the ways in which beliefs and role assumptions determined 
conference actions. 

Tvnoloiiv of Conference Dialogiie/Bchavior.s 
Type I Conferences : 

This type of conference involved educators (principals, master teachers and teachers) who 
were resistant to "change" as represented by the STAR and tlie new assessment process. Participants 
in tliese conferences were adamant in holding on to stereotypic role hierarchies in which the principal 
and/or master teacher would characteristically monopolize most of the conference discussion with il^e 
teacher simply being relegated to a "passive listener" role. This Type I conference style was clearly 
evident m only one set of conferences (high SES high school) observed in this study. These 
conferences, although atypical of the majority of conferences observed, served to highlight ilie 
disjunctive nature of tlie stereotypic, hierarchical roles and the STAR model roles. For example, in 
the Type I Conferences observed, as the "outside assessor" team member (one of the university 
researchers) would attempt to initiate focused discussions with the teacher about classroom 
observation events, the principal would frequently interrupt and diffuse the discussion with comments 
about policy/implementation concerns, as well as reminders to participants about ilic schedule and 
conference timelines. Consequently, discussions during tliese conferences were largely procedural 
in focus, with little attention paid to reflecting on lesson events. The predominant metaphor surfacing 
in tliese conferences was that of the teacher as victim. 



2b 



28 

In tliese Type I conferences tlie principal and/or master teacher would also engage ii 
behaviors tliat indijated ihey fell somewhat victimized by the conference process itself. Comments 
were made by principals and master teaciiers participating in these conferences concerning tJie 
significant amount of "extra time" that was required for the preparation, scheduling and completion 
of these conferences. 
Tvpe IT Conferences : 

These conferences were characterized by educators who assumed tlie metaphoric roles 
(alternately, or in combination) of expert panel, grievance committee and support group. Like the 
teacher as victim metaphor observed in the Type I confcrencesi the transfercntial metaphoric roles 
assumed by some conference team members of expert panel and grievance committee were also found 
to be reflective of stereotypic role hierarchies associated v/ith traditional models of "dh'ect" 
supervision. These kinds of role hierarchies acted unconscious inhibitors to collaborative 
conference dialogue. Participants engaging in these roles often stated their willingness to "share" as 
professionals. However, as these Type II conferences progressed, the stereotypic role differentiations 
would take precedence in varying degrees and begin to dominate the dialogue. These kinds of roles 
prevented collaborative, context-specific and data-based sharing among team members and the teacher. 
The surfacing of these role hierarchies during these conferences and their effects on conference 
discussions suggests the strong influence of participants* underlying beliefs on these roles luid tlie 
normative nature of these beliefs. 

In some of the Type II conferences observed, the expert panel role was utilized by team 
members in a way that was more tt'ansaclional than transfercntial (CMIVEC, Appendix V). In these 
instances Uiis metaphor was often employed in conjunction with the support group role as team 
members would engage in discussions with the teacher in order to clarify interpretations of indicators, 
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offer leachijig and learning examples, and provide die teacher widi relevant assessment information. 
As the conference team as support group metaphor was found to be employed in these Type 11 
conferences, participants assumed diis role iji a somewhat passive sense. Although Uiere was some 
variability in die degree of transactional usage of diis metaphor in these Type II conferences, 
participants' verbal statements and behaviors indicated a weak team commitment in terms of 
willingness to play out the role of being a tnie "support group". 
Tvne ITI Conferences : 

Wliile a few of die conferences observed involved participants vvlio were resistant to change 
(Type I Conferences), the majority of die conferences observed in this study involved teachers and 
assessors (principals and master teachers) who evidenced a willingness to change, but who were 
impeded in their change efforts by contradictory normative beliefs diat reinforced transferential 
participant role hierarchies and inhibited effective role empowerment during conferences (Type II 
Conferences). However, in a few of the conferences, a s<.'v- /hat greater degree of openness on die 
part of participants to assuming the STAR reflective and collaborative conference roles was observed. 
As diese teachers and assessment team members became involved in conference discussions, then- 
willingness to interact as "reflective professionals" and "collaborative learners" allowed them to focus 
their discussions on specific teaching and learning events from the classroom observations. Liitiation 
by one or more conference panicipants of a detailed discussion about particular teaching and learning 
events from the classroom observations was found to serve as a catalyst for an observed change in 
the conference dialogue. Through focusing on context-specific classroom events, participants were 
naturally compelled to adopt a reflective stance toward the data. As this change in dialogue occurred, 
the teaci er began to assume a greater role in leading the discussion. This occurred as assessment 
team members realized that as they each had knowledge of die teaching and learning data from dieir 
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own observations, Uie teacher alone possessed all of the classroom data. 

Post-conference interviews willi participants in Tyi^e III conferences confirmed tiiat these 
educators did indeed come to a reahzation during the conferences tliat tlie teacher should play a 
"leading" role in tJie reflective, collaborative process. Since the STAR process of collaborative 
learning involves a mutual sharing of the perspectives and insights of assessors and teacher, llie 
teacher can contribute substantially to the conference dialogue through active involvement in reflective 
thinking and discussion witli llie team about teaching and learning. By being more receptive to die 
STAR reflective and collaborative conference roles, participants in Type III conferences were able 
to engage in discussions that were more context-specific and data-based. Additionally, tlirough 
directing the discussions in this manner, the teacher and team members were afforded more 
opportunities to reflect on events focusing specifically on the enhancement of students' learning. 

These three conference types highlight the extent to which educators' beliefs, and the 
conference roles emanating from them, can impact on tlie reflective and collaborative quality of 
conference dialogue and behaviors. Type I and Type 11 conferences were both characterized by 
metaphoric role usage tliat resulted in varying levels of transferential empowerment among 
participants. In these conferences the metaphoric roles and role ensembles employed framed the 
discussions in ways that inhibited a focus on professional learning. In the Type II conferences it was 
discovered tliat metaphoric roles are malleable and that they can be transfonned (become more 
transactional) through the assumption by participants of a more open and collaborative posture. Such 
was 'he case witli the expert panel metaphor, and to a lesser extent with the metaphor of conference 
team as support group. As participants altered their conference "focus" away from technical concerns 
and toward uicreasing their understandings of the classroom observations and teaching and learning 
data, the opportunities for professional development and growth increased. In tlie Type III 
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conferences, as participants* beliefs became less rigid and allowed for an openness to change and 
learning, educators were more receptive to the potential of the conference framework for facilitating 
professional development. Therefore they were able to more successfully assume reflective and 
collaborative roles during conferences. These roles enabled participants to view the STAR 
conferences as opportunities to share each others' professional knowledge and expertise and to focus 
the discussions on improving students' learning. 

Impiicalions of (he Study 

These findings provide supportive evidence for ilie notion tliat differential usage by educators 
of metaphoric framings within tlie context of teacher assessment conferences is tied to the assessment 
framework credibility of tlie team conference as a useful vehicle for teachers' positive professional 
growtli. Tliis study has implications for the effective use of team conferences as a viable component 
of statewide teacher assessment/certification programs. Assessment team members and teachers 
employ varying interactive metaphors during conference activities. As these metaphors affect tlie 
extent to which members are able to successfully assume appropriate conference roles, these 
contextual metaphors become barometers of the relative effectiveness of the assessment framework 
to generate positive teacher professional development and growtli. Analyses of educators' beliefs and 
conference metaphors discerned in this study, and the typology of conference dialogue/behaviors 
emerging from them, suggest that normative belief strucuires and their effects on educators' behaviors 
act as important determinants of the potential of statewide assessment initiatives sucli as the STAR 
for realizing professional growth and change. This findijig points to the desirability of designing and 
incorporating staff development components as integral features of these statewide implementation 
efforts. Increased understanding among educators of the ways in which metaphoric framings can be 
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encouraged and utilized effectively in team conference settings has valuable staff developnient 
potential for creating increased opportunities for teacher professional growth. Additionally, as 
statewide teacher assessment initiatives continue to be implemented, and as the demand for greater 
teacher accountability and professionalization increases, tlie long-tenn effects of these programs 
become an increasijig concern. Through involvement w school-based staff development activities, 
teachers, principals and master teachers can be more effectively prepared in techniques of 
collaborative reflection ajid professional sharing appropriate to team conferences* Post-assessment 
conferences, when engaged in correctly by participants, demonstrate positive potential for promoting 
professional collaborative reflection on action. The linking of a collaborative conference model to 
the teacher assessment/certification process (as is the case in the STAR) seems a viable approach to 
derivmg greater long-term "benefit'* from die implementation of statewide certification mandates. 
This benefit comes in the form of increased potential for shared commitment by botli teachers and 
assessors towards ongoing, meaningful professional development and learning (reflection in action). 

This study serves to emphasize the importance of interpreting and understanding tlie namre 
of educators* beliefs and how these beliefs in conjunction witli contextual factors influence the team 
conference component of teacher assessment programs. Through a more informed understanding of 
tlie impact of educators* beliefs on metaphoric roles assumed during team conference activities, 
assessment program developers will be better equipped to design more effective certification models 
that encompass not only classroom-based assessments of teaching and learning, but also professional 
peer review and collaborative conferences targeting educators* professional development and growth. 
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APrifilNUlX I 



STAR 

System for Teaching and Learning Assessment and Review 



PERFORMANCE DIMENSION 1: PREPARATION, PLANNING, AND 

EVALU MION (26)a 

TEACHING AND LEARNING COMPONENTS 

A. Goals and Objectives {4)b 

B. Teaching Methods and Learning Tasks (4) 

C. Allocated Time and Content Coverage (4) 

D. Aids and Materials (4) 

E. Home Learning (3) 

F. Formal Assessment and Evaluation (7) 



PERFORMANCE DIMENSION II: CLASSROOM AND BEHAVIOR 

MANAGEMENT (23) 

TEACHING AND LEAR'siNG COMPONENTS 

A. Time (6) 

B. Classroom Routines (4) 

C. Student Engagement (1) 

D. Managing Task-Related Behavior (6) 

E. Monitoring and Maintaining Student Behavior (6) 



PERFORMANCE DIMENSION III: LEARNING ENVIRONMENT (13) 

TEACHING AND LEARNING COMPONENTS 

A. Psychosocial Learning Environment (10) 

B. Physical Learning Environment (3) 



PERFORMANCE DIMENSION IV: ENHANCEMENT OF LEARNING (55) 

TEACHING AND LEARNING COMPONENTS 

A. Lesson and Activities Initiation (8) 

B. Teaching Methods and Learning Tasks (6) 

C. Aids and Materials (6) 

D. Content Accuracy and Emphasis (6) 

E. Thinking Skills (11) 

F. Clarification (4) 

G. Monitonng Learning Tasks and Informal Assessment (6) 

H. Feedback (4) 

I. Oral and Wntten Communication (4) 



a Nunber of Assessment Indicators Comprising Performanco CmenslO'i 

b Number of Assessment Indicators Comprising Teaching and Learnin-i Component 
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PERFORMANCE DIMENSION IV: ENHANCEMENT OF LEARNING 

An important dimension ol elfective teaching is the interactive process of teaching and learning. Effective initiation 
of a lesson or of an activity within a lesson involves securing student attention, clearly communicating expectations, 
and providing an appropriate context for new learning. An effective lesson proceeds in a logical sequence, and 
continuity is ensured through sucH techniques as summarizing and reviewing. The lesson should end with appro- 
priate closure. Methods and tasks and related aids and materials' are appropriately used in ways that facilitate 
achievement of planned objectives. Information presented by the teacher should be accurate, up-to-date, and 
communicated clearly using appropriate vocabulary tor the developmental and ability levels of the students. During 
leaching and learning acllvities, essential element:, are emphasized and effective questioning techniques are used 
to exlend thinking skills. Throughout the lesson, r.ffeclive monitoring techniques are used and student perlormance 
is informally assessed. Areas of student misunderstanding or diHiculty are effectively and efficiently handled 
Adjustments in teaching and learning are made where indicated by student performance. Students receive feedback 
that is specific to tlie individual and to the learning task and are afforded sufficient opportunities for practice to 
ensure achievement of planned objectives. The teacher provides a good model of oral and written communication 
that is correct, easily understood, and appropriate for student perlormance levels. 



TEACHING AND LEARNING COMPONENTS 



IV. A. Lesson and Activities 
Initiation 



IV. F. Clarification 



IV. B. Teaching Methods 
and Learning Tasks 

IV.C. Aids and Mr'cerials 



IV. G. Monitoring Learning 
Taskes and Informal 
Assessment 



IV. D. Content Accuracy 
and Emphasis 

IV. E. Thinking Skills 



IV.H. Feedback 



IV.l. Oral and Written 
Communication 
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■CACHING AND LEARNING COMPONENT .V-G: MONITORING LEARNING TASKS AND ,NPORMAL ASSESSMENT 



COMMENTS: Act^-ely moniloring sludent involvemeni in learnina ta«;k«! ihmnnh. . , 

in portant element of effective leachinn Inrt ill ■ , . 'hroughoul the lesson is an 
provide the teacher w lh info ma io^^^^^^^ assessment techniques 

tasks. Because leaniing proceeds thr^^^^^^^^^^ ""^erstanding of content and learning 

ment activities should SL^n^nuou f s^^^^^^^^^^ ^^^^^s' 
0. p— g learning tasKs. a.usLe^lsl^rch- ^^^^^^^^^ 



RESEARCH BASE 



cle^r^artSrd^l^^^^^^^^^ giving .He.r students 

ingersoll (1981) report that on task behaUis rnlinta?npd ff .^^^^^ subsequent learning activities. Goss and 
teacher. They further point out that teache w^rr^onhor el^^^^^^^^^ I^h "^^^ '^^"^S ^^'^''^^^^ by the 

progress of students and are sensitive to stuTenTs undeXL^^^^^^^^^^^^ '° ^^f '^^^'^'"9 involvement and 

suggest that monitoring to students" comprehension of Seria?s fnH «. / '^^ ^-^^ EfTimer(i979) 

unacceptable behaviors during teaming activiLs?s an efS^earhlL hT"' °'fh^^'<''^9 for acceptance and 
and Emmer (1982) conclude that student achievemenf levers^ ^^^^^^^ ^"'^'^^^ ^^^^son (1980) 

consistent moniloring techniques throughout the course ofThi r fessons ^^^^^ '^^^hers utilize 
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TEACHING AND LEARNING COMPONENT IV^G: MONITORING LEARNING TASKS AND INFORMAL ASSESSMENT 



ASSESSMENT INDICATORS 

IV. G.I Monitors students* initial 
engagement in learning tasks 



ANNOTATION 

Indicators IV.G.1 and IV.G.2 address a complex 
set of teacher behaviors that represent more than 
random questions or movement ^ around the 
classroom. Monitoring and addressing the 
intensity and qualrty of engagement provide the 
teacher with more information atx)ut students* 
initial and subsequent learning than simply 
monitoring students' attention to tasks. As 
students begin initial and subsequent learning 
tasks, the teacher should immediately scan the 
class to monitor students* engagement in learning 
or perhaps ask appropriate questions. Simply 
nx)nitoring nonverbal behaviors may be sufficient 
in some contexts. For example, scanning for eye 
contact with students is an effective technique as 
a lecture/discussion method is initiated. 
Monitoring the quality or other kinds of student 
nonverbal behaviors is applicable in other 
contexts (e.g.. as students begin taking notes or 
writing as part of an individual seatwork task). 



NOTES/CLARIFICATION 



IF THE INITIAL ENGAGEMENT OF ALL 
STUDENTS IS NOT MONITORED, THIS 
INDICATOR AS UNACCEPTABLE. 



4'<: 
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TEACHING AND LEARNING COMPONENT IV.G: MONITORING LEARNING TASKS AND INFORMAL ASSESSMENT 

ASSESSMENT INDICATORS ANNOTATION NOTES/CLARIFICATION 

IV.G.2 Monitors students' engagement During learning tasks, the teacher can use a 
during learning tasks variety of purposeful methods to rronilor 

students' engagement in learning. Students' 
nonverbal behaviors, such as the intensrty of 
facial expressions and body movements, (e.g., 
frowning and squirming), verbal behaviors such 
as studenls' responses to targeted questions and 
student explanations, and more complex 
behaviors such as students completing small 
group tasks, can be monitored for engagement. 

IF STUDENTS' ENGAGEMENT DURING 
LEARNING TASKS IS NOT ACTIVELY 
MONITORED, THIS INDICATOR AS 
UNACCEPTABLE, 

IV.G. 3 Monitors the complelion of Once students are engaged in a learning task, 
learning tasks the teacher should continue systematically 

rronitoring engagement until the task is 
completed. Such monitoring provides the teacher 
with information about whether learning tasks can 
be completed within the time allotted, whether the 
pace of learning tasks fits students' capabilities 
and whether students are accomplishing learning 
objectives. There is also an element of efficient 
lime management in closely monitoring the 
completion of tasks since "early finishers" should 
not waste time and watt on "slow doers". 

IF THE TEACHER DOES NOT ACTIVELY 
MONITOR AL ' STUDENTS' COMPLETION OF 
LEARNING iASKS, THIS INDICATOR IS 
UNACCEPTABLE, 

4.1 44 
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TEACHING AND LEARNING COMPONENT IV.G: MONITORING LEARNING TASKS AND INFORMAL ASSESSMENT 



ASSESSMENT INDICATORS 

IV.G.4 Solichs a range cl responses 
Irom students to assess a 
variety ol levels ol learning as 
appropriate 



ANNOTATION 

Um of Inlormal aM«Mment tochnlq. 
provides Ihe toacher whh Intormalton aboui 
.sluderrtB' progress toward or mastery of 
teamInQ objectives during the lesson. Range 
ol responses Includes a variety (at least two) 
of cognitive levels of '.jamlno and a variety 
(at least two) of task responses to 
demonstrate learning and mastery of 
ot)}ecllves. Multiple learning iasl<s are 
structured by the teacher. Therelore. a range o( 
task responses can bo solicited Irom students to 
inlormally assess learning. The range ol 
responses selected should reasonably match the 
goals/objectives o( the lesson and variation in 
students" development and ability levels. 

Aaivo monitoring during teaching and learning is 
taciiitated when the teacher deliberately seeks 
inlormation from students as to whether or not 
the lesson is "tal<ing." Comments, questions, 
answers and derrxsnslrations arc sought Irom 
students lor inlormal assessment purposes. 
Generalized questions such as. "Do ali ol you 
understand?', are nol spocilic enough. 

Not all inlormal assessment techr^iques reflect 
inlotmalion about learning at the same cognitive 
and/or perlormance level. Eltective teaching and 
learning proceed at more than one 
cognitive/perlormance level. Therelore. the 
teacher should solicit student responses that 
demonslralo a sufficient variety o\ cognitive levels 
giving consideration to student characteristics, 
learning objectives and learning tasks. 



KJOTPci/CLARinCATION 
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TEACHING AND LEARNING COMPONENT IV.G: MONITORING LEARNING TASKS AND INFORMAL ASSESSMENT 



ASSESSMENT INDICATORS 



ANNOTATION 



NOTES/CLARIFICATION 



Queslioning techniques In a high school history 
lesson, for example, might vary in level Irom 
simple knowledge and recall lo evaluation and 
synthesis. Variety implies more than one 
cognitive and/or perlormance level. 



IV.G. 5 Summarizes or reviews during 
the lesson to nx)nitor/assess 
the pace of leaching and 
learning 



IF A VAR'ETY OF LEVELS OF LEARNING IS 
NOT ASSESSED USING A RANGE OF 
STUDENT TASK RESPONSES. THIS 
INDICATOR IS UNACCEPTABLE, 

Periodic summaries or reviews ol lesson 
content/activities are an efticienl means ol 
rronitoring the pace ol teaching and learning. 
Reviewing lor pace can occur at any point during 
the lesson. Such reviews provide the teacher 
and studenl(s) with feedback about the pace of 
activities. 



General questions such as "Are all of you 
keeping up with me?" are not sufficient. Specific 
probes by the teacher must follow. 

Of course, reviews are also important ways to 
link prior and future leaching and learning 
activities and to provide lesson continuity. 
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TEACHING AND LEARNING COMPONENT IV.G: MONITORING LEARNING TASKS AND INFORMAL ASSESSMENT 



AQQFC^QMPNT INDICATORS 



IV.G. 6 Adjustments within the lesson 
are made as needed **0f** no 
adjustments are necessary 



ANNOTATION 

Reviews for pace are most appropriate at the 
begir)nir)g of a lessor) or at po/nfs of trar)Sitior) 
before movlrig on to new content or learning 
/asks. Initial reviews of past learning to ensure 
students' readiness for new learning (Indicator 
IV.A.7) may be completed with no attention given 
to pace. Reviews or summaries can be done for 
individual students or student groups. 

IF SUMMARIES AND REVIEWS OF LESSON 
CONTENT AND ACTIVITIES ARE NOT 
EVIDENT, THIS INDICATOR IS 
UNACCEPTABLE. 

Informal assessment techniques provide the 
teacher with information needed to mal^e 
adjustments in teaching methods and learning 
tasks. If assessment information obtained from 
students suggests that the lesson is not "taking" 
as intended, adjustments in teaching methods 
and leaming tpsks should be made. Probing for 
the basis of misunderstanding may be required 
before appropriate adjustments can be made. 



NnTPS/CLARlFICATlON 
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TEACHING AND LEARNING COMPONENT IV.G: MONITORING LEARNING TASKS AND INFORMAL ASSESSMENT 

ASSESSMENT INDICATORS ANNOTATION NOTES/CLARIFICATION 

Adjustments may Involve the difftcutty level of 
content, changing teaching methods, assigning 
new leaming tasks and/or providing additional 
resources. Of course, when only one or a small 
number of lo« ners have ditflcutty, adjustments 
are not needed for the entire class. Confusion 
might be clarified during the lesson (Teaching 
and Learning Component IV. F) with no necessity 
of making adjustments in the lesson. 

IF INFORMAL ASSESSMENT TECHNIQUF.S 
SUGGEST THAT ADJUSTMENTS SHOULD «E 
MADE AND THESE DO NOT OCCUR, THIS 
INDICATOR IS UNACCEPTABLE. 



ERIC 



5> 



135 



I 



APPENDIX III 



STAR DEVEL PflOC CIRCLE 1 1/21/90 6 24 PM 



STAR 

Professional Development 

Process 



1) Observational 
AssessiM|r 

( Da\a CoVmSr^ 



Ongc^Bg Support 
Actlym08 



6) CBaborative 
^^^toring 
anoKeedback 



2) Individual Reflection 

ind Analyze) 

3) CoN^^ive 
Discusspi 

V Negotiate ^w^f^Q^^^ 
cS Weaknes^m, 

/ Target - Enhamtog 
Students' ieaW 

4) Professic&l 
Deveiop|||nt 
Commltiiints 

✓ Professionmwowth 

Activities fm 
/ Resourcf, 
/ Timelii 



imentation q 

Pro 

/ impievnenr m^ 
/ Collect Data 
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STAJR 

CONTINUING PROFESSIONAL 
DEVELOPMENT PLAN 



Teach&r: 

Observation Dates: 



SSN: 



Performance Strengths: 




Professional Growth Areas: 

Performance Dimension(s): 
Component - Indicators: _ 



DEVELOPMENT 
ACTIVITIES 



PERSONS 
RESPONSIBLE 



RESOURCES 



TIMELINES 
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Approximate Date of Next Conference: 



APPENDIX V 



CONFERENCE METAPHORIC ROLE/ 
EMPOWERMliNT CONTINUUM 



TRANSFERENTIAL 
EMPOWERMENT 



TRANSACTIONAL 
EMPOWERMENT 



TRANSFERENTIAL 
METAPHORIC ROLES 



TRANSACTIONAL 
METAPHORIC ROLES 




